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2 

ACCESS CONTROL METHOD AND APPARATUS 
The present invention relates to a method and apparatus for controlling access 
to one or more servers in a computer network, and more particularly relates to a 
method and apparatus that controls the admission of new users to the one or more 

5 servers such that users already accessing server resources will receive priority service 
over new users attempting to access a server. 

In a computer network, such as the Internet which represents a vast number of 
computers linked to each other worldwide, information exchange such as email may 
occur between various computers linked through the Internet using a set of protocols 

10 such as the transmission control protocol/Internet protocol (TCP/IP). A "client" may 
typically be a web browser running on a computer. A client typically communicates 
with a "server". A server may uniquely distinguish clients using an IP address and 
possibly other identifiers. Other examples of clients include proxy servers and web 
robots. Information on the Internet may be made available to the public through 

15 "servers". Servers are computers which make available files or documents they hold. 
The worldwide web (www) is a method of accessing this information from the servers 
and allows a user to navigate the resources of the Internet by displaying or 
downloading pages of information that are stored at the servers. Clients communicate 
with servers using the hypertext transfer protocol (HTTP). In the Internet the HTTP 

20 protocol is generally transmitted over TCP/IP. 

Usage of the Internet and the worldwide web is increasing at a very rapid rate 
and more and more new users are being connected to the Internet and www. As its 
growth continues, the www will provide a rapidly growing number of commercial 
services, with applications ranging from information retrieval for text, images or multi 

25 media through to purchasing, for example, ticket and item sales. As such, there is a 
need to improve the reliability of the web so as to make it a suitable medium for high 
volume, business critical applications. 

During periods of high use of a web server, even in situations such as overload 
of the server wherein the load of requests to the web server exceeds the capabilities of 

30 the server, the server still allows requests from new users. These capabilities include 
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the physical capacity of the CPU, the memory and the network. Continuing to allow 
requests from new users tends to degrade the performance perceived by users that are 
already accessing the server system and which is evidenced through long delays or 
inability to service information requests. For example users already accessing web 
pages on a server may experience poor performance as they navigate through links to 
pages on that same server. The performance as perceived by already accessing users 
is assessed in terms of maintaining throughput, response time levels and system 

stability rather than by increasing the overall throughput of the web server. 

The present invention seeks to address this problem by providing a system that 

allows a server to accept or deny access by new users to that server in preference to 
. those already accessing the server. Such a decision for accepting or rejecting the 

admission of new users is based on certain performance parameters, such as the 

setting of the congestion level at the server. 

Accordingly, the present invention provides a method for controlling access by 

a client to a server in a computer network, said method including the steps of: 
monitoring resource usage of said server; 

allowing a connection of said client to pass to said server where said connection 

forms part of an "active session" such that said connection forms part of said "active 

session" if at least one previous connection from said client has been passed to said 

server within a predetermined time interval, and 

allowing or rejecting a new connection of another client to pass to said server 

according to an admission control scheme based on said server resource usage. 

The method may include searching for an active session of said client and 

admitting the client's connection to pass to said server if there is an active session for 

said client. 

The method may include determining a congestion level from monitoring the 
resource use on said server. The congestion level may be represented by a whole 
number between zero and c^ where zero indicates that the server is operating 
normally and c^ is the maximum congestion level. The congestion level may be 
) used to calculate an admission interval which represents the time after which a new 
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session for a new connection can begin. 

A new connection may be admitted after the admission interval expires. 
Periodically, a determination is made on whether the resource usage is high, and if it 
is high the congestion level is increased. The method may include checking whether a 
5 client has had a connection attempt rejected within a predetermined period. 

The present invention also provides an interface unit for controlling access to a 
server by a client in a computer network including: 

means for monitoring resource usage of said server; 

admission means for allowing a connection of said client to pass to said server 
10 where said connection forms part of an "active session" such that said connection 
forms part of said "active session" if at least one previous connection from said client 
has been passed to said server within a predetermined time interval, 

said admission means also rejecting or allowing a new connection of another 
client to pass to said server according to an admission control scheme based on said 
1 5 server resource usage. 

The monitoring means may be in the form of a database that maintains 
information about previous sessions, a list of active sessions and routinely polls said 
server to obtain resource information on that server. The interface unit may be linked 
to the computer network through an external port and be linked to the server through 
20 an internal port. The interface unit may be a computing processor and the admission 
means may be a control unit for rejecting or admitting a new connection to said 
server. 

The invention will now be described in a preferred embodiment with reference 
to the accompanying drawings wherein: 
25 Figure 1 shows a computer network system that links clients to servers through 

the network: 

Figure 2 is the system of Figure 1 showing just one interface unit linking one 
server to a number of clients through the network: 

Figure 3 is a diagram showing the individual components of a server and 
30 interface means. 
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Figure 4 is a flow diagram of a first connection admission control scheme; 
Figure 5 is a flow diagram of a second connection admission control scheme; 
Figure 6 is a detailed view of one decision point in the flow diagram of Figure 

4; 

5 Figure 7 is a detailed view of one decision point in the flow diagram of Figure 

5. 

Figure 8 shows the flow of message streams through the interface means 
between servers and clients; 

Figure 9 is a flow diagram of a first implementation of the interface means; 
10 Figure 10 is a diagram of buffer and stream management for the 

implementation of Figure 9, and 

Figure 1 1 is a process diagram of a second implementation of the interface 

means. 

In Figure 1 there is shown a system 2 that links one or more clients 4, either 

15 being workstations or PCs, with one or more servers 6 through a computer network 8, 
such as the Internet. Each of the servers 6 is connected to the computer network 8 
through interface means 10. Typically when a user wishes to access a server 6 for the 
purpose of reading or downloading a web page, they will initially input the address or 
universal resource locater (URL) identifying a web site or web page that one or more 

20 server 6 will handle or have stored. Where one of the servers 6 has many requests to 
obtain information for a number of users it can become overloaded and consequently 
provide a degradation in service to each one of the users accessing the server 6 
through respective clients 4. In situations where the demands on a server 6 are high, 
even on the verge of overloading the server 6, the interface means 10 which is 

25 implemented as a computing processor, and more particularly as an interface unit, 
monitors critical resource usage on the server based on predefined parameters, and 
maintains a derived parameter known as the congestion level of the system. Based on 
this congestion level, the interface means 10 controls a number of new users allowed 
to access data on the server 6. At this stage each of these new users are defined as 

30 "not participating in an active session" on server 6. Thereafter any one of these new 



REO.FPH:W26J6B.PRV 



20 April 1998 



6 

users that is allowed to access data is then said to have an "active session" on the 
server 6. All other users are rejected and are said to "not have an active session" on 
the server 6. The definition of "active session" generally is that the user has 
communicated with a server within a defined period, typically the last N minutes. 

5 This definition is based on user behaviour, for example, where a user downloads a 
page, spends a short period of time reading the page, then downloads another page 
and so on. The interface unit 10 also determines, in real-time, the rate at which new 
requests to the server 6 can be accepted while still providing an acceptable quality of 
service for already accepted requests. It also maintains a table of "active sessions", 

10 and accepts an appropriate rate of new requests while rejecting all other new requests. 

The interface unit 10 implements an admission control scheme to determine 
whether users are admitted or rejected. This determination is based on a current and 
past server resource use at the web server 6 such as memory capacity, bandwidth use 
on the link from the server 6 to the Internet 8, resources available on the interface unit 

15 10 and processor load or utilisation. Specifically, server resources that are monitored 
include CPU utilisation, number of pages, number of pages swapped in and out, 
memory used, number of disk input/output operations and average disk delay since 
the last poll by the interface unit 10 of the server 6 for its current resource usage took 
place. If sufficient resources are not available, a rejection message (possibly with an 

20 explanatory note) is sent to users who attempt to gain admission but are not admitted. 

As mentioned previously, any one or more of the servers 6 communicates with 
each of the clients 4 through the interface unit 10 over the computer network 8. The 
interface unit 10 may be connected to several servers 6 and determines admission of 
new sessions by monitoring resource usage on each server 6. A session with a client 

25 represents at least one admitted connection from the client. Referring to Figure 2, the 
interface unit 10 is linked to the Internet 8 through link 12 and to the server 6 through 
link 14. Generally it is preferred that the bandwidth of the link 14 between interface 
unit 10 and server 6 exceeds the bandwidth of link 12 between the interface unit 10 
and the computer network or the Internet 8. 

30 The architecture Figure 2 can be realised in several different ways. Firstly, the 
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interface unit 10 can run on a multihomed computer with one connection running to 
the Internet 8 and another connection to the computer that supports the. server 6. A 
multihomed computer has two or more physical interfaces to Internet protocol based 
networks. Secondly, the interface unit 10 can run on the computer supporting the web 
5 server 6 with the interface unit 10 using Internet domain sockets to communicate with 
the Internet 8 and Unix domain sockets to connect to the web server 6. The HTTP 
protocol is used on both the Unix domain and the Internet domain sockets. Thirdly, 
the interface unit can be built into the web server 6 so that all communication with the 
Internet 8 is performed by the interface unit module and communication with the 
10 server component is implemented through either function calls or shared memory. 

In Figure 3 there is shown the components of each of the interface unit 10 and 
the web server 6. An external port 16 of the interface unit 10 is a port supporting the 
HTTP protocol that connects the interface unit 10 to the Internet 8. An internal port 
18 of the interface unit 10 is a port connecting the interface unit 10 to the www server 
15 6. The ports are bi-directional. The number of outstanding connection requests which 
a port can maintain may be limited. Connections are stored in a buffer associated with 
external port 16 which must be polled to extract data. After polling, the IP address of 
the connection's client is then known. Data must be placed in a buffer associated with 
the external port 16 to be sent. The IP address is a unique identifier of a computer 
20 connected to the Internet 8 and each client is identified by such a unique IP address 
possibly in connection with further information. 

A connection between the interface unit 10 and the client 4 is said to exist from 
when the interface unit 10 polls the port for the connection until the connection is 
closed. Data can be transferred bi-directionally through a connection. A client may 
25 begin an unrestricted number of connections, for example, a page request from a web 
browser typically requires a connection to receive the text and a connection for each 
graphical image. Under HTTP 1.0 a connection is closed by the server 6 immediately 
after the information has been transferred. Connections may be closed immediately 
by the server 6 and a connection does not imply admission to the server 6. Connected 
30 between the external port 16 and internal port 18 is a control unit 20 that admits or 
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rejects a connection to the server 6. Control unit 20 admits or rejects new users in 
accordance with an admission control scheme to be described. A storage means 22, in 
the form of a history data base, implemented as a memory unit, maintains current and 
recent information for determining admission of connections such as: 
5 - resource usage, 

information about previous sessions and their resource usage so that 

predictions may be made about a future session, 

a list of active sessions of clients who currently have access to one or 
more servers, and 

10 - in the case of a percentage throttling admission scheme (to be 

described), a history of rejected clients is alsp stored. 
An active session is said to exist if the last connection from a client was made 
within a specific time interval,, which is likely to represent the time period necessary 
to read a web page. A session ends when no connections are received from the client 
15 for the specified time interval. An active session must be associated with a history 
entry and a client. 

When a new client connection is accepted by the interface unit 10 for the 
server 6, an entry is added to an "Active Session Table" in the history database 22. 
The entry includes the time at which the last client-server interaction occurred. This 

20 interaction can be either a user request arriving or the transmission of information 
from the server to the client. If more than rNACTIVE_SESSION_TIMEOUT 
seconds elapses between server-user interactions, the session is deemed inactive. This 
is an indication that the user is no longer interested in the server 6. Inactive sessions 
are removed from the Active Session Table. 

25 The history data base 22 obtains information on resources of the server 6 from 

' a server storage means 24, in the form of a resources data base, over link 26. The 
server storage means 24 resides within the server 6. Every 
STATUS_REQUEST_TIME seconds, the database 22 polls the resources database 24 
for that server's current resource usage. A server processor 28 handles all of the 

30 requests from various users for obtaining web pages and the like and is linked to the 
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internal port 18 of the interface unit 10 through link 14. 

The operation of the interface unit 1 0 will now be described with reference to 
an admission control scheme called call gapping admission. With reference to Figure 
4 there is shown a flow diagram of the processes involved using the call gapping 

5 admission control scheme. The processes of the server 6 operate in a continual loop 
and are divided up into two sections, one being for the admission control part 402 the 
other being for the data transfer and history updating part 404. At step 406 the 
interface unit 10 listens or checks for connections from any one of the clients 4 at the 
external port 16. The external port 16 may store connection requests in a queue buffer 

10 or a connection request queue for a limited time. The external port 16 must be 
checked often for connections to avoid loss of connections including those for active 
sessions. If there are no connections from clients, flow proceeds to step 424 of the 
data transfer and history updating part 404. If there is a connection the process moves 
to step 408 where the history data base 22 is queried for an active session having the 

15 same IP address as the client making the connection. Only one connection can be 
handled for each iteration of the outside loop. If there is an active session, the 
connection is accepted by the control unit 20 and provided that there is an available 
"connection slot" at step 416. A connection slot is required for the transfer of data 
through a connection such that the slot maintains information relevant to the 

20 connections such as buffers, buffer sizes, the IP address associated with the external 
port buffer and the file handles for the connection. Data is stored in the internal port 
buffer prior to sending. If there is no available connection slot the connection is 
closed at step 422. If no data (including a rejection message) has been sent from the 
external port 16 to the client 4, the connection has been ignored. If there is a 

25 connection slot available the process proceeds to the data transfer and history updating 
part 404 starting at step 424. If the connection is a new connection it will only be 
added at step 418 if it meets the criteria of the call gapping admission scheme. A new 
connection is a connection from a client for which the history database contains no 
information. A new connection originates from a client who is "currently not 

30 participating in an active session" with server 6. The admission of a new connection 
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begins an active session. The call gapping admission scheme allows one new session 
to be started only after a calculated time interval has elapsed since the last new session 
began. This time interval is determined by the current congestion level. The 
congestion level is a measure of how much traffic or requests are initiated from the 

5 clients 4 and is determined by monitoring resource use on one or more servers 6 and 
the utilisation of the link 12 to the Internet 8. A congestion level is represented by a 
whole number between zero and c mx inclusive where Cirax is the maximum congestion 
level, with zero meaning that the server is operating normally. Therefore a high 
resource use increases the congestion level while a low resource use reduces the 

10 congestion level. Thus, when a request or connection arrives, a search is made of the 
Active Session Table. If the connection comes from an active session, it is 
im mediately passed through to server 6. This gives priority to active sessions over 
new sessions. 

Going back to step 408, if no active session is found through the search then 
15 the process proceeds to step 410 where a search is conducted for a "history entry" or 
an expired one that may be recycled if it exists. A history entry stores information 
about a client such as the last time that a connection from a client was closed and the 
IP address of the client, Ftistory entries may be recycled if they do not represent an 
active session. If there is no empty history entry the process moves to step 422 where 
20 the connection is closed. If an empty history entry is found or an expired one is 
recycled, then the process moves to step 412 and the connection is either admitted or 
rejected according to the call gapping admission scheme. For a connection to be 
admitted or for a rejection message to be sent, there must be a history entry available. 
If not, the connection is closed immediately. 
25 With reference to Figure 6 the processes involved in admitting or rejecting a 

connection is disclosed in greater detail. Firstly at step 413 the admission interval is 
calculated. This is the interval after which a new session may begin and is a function 
of the congestion level. Firstly f (c) is calculated where c is the congestion level and f 
is a function which determines the time interval given the congestion level c. The 
30 process then moves to step 415 where an admission or rejection determination is 

20 April 1998 
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made. A new connection will be admitted if 

t-t,'>f(c) 

where t is the current time, t , is the time of the last admission. If this is true then the 
connection is admitted and the process moves to step 417 where the last admission 
5 time is set. This is where the time of the last connection admission is updated to the 
current time, in other words, 

t, = t. 

If the connection is admitted, a new active session begins provided a connection slot is 
available at step 416. A new history entry is then entered in the history data base 22. 
,0 If the new connection is rejected the process moves to step 414 where a check is made 
for a connection slot, and if one is available, then a rejection message is added to the 
external port buffer for a specific client at step 420. If no connection slot is available 
then the connection is closed at step 422. The process reaches step 424 where a check 
is made to see if a constant time interval I has elapsed such that 

t-t u >I 

where t is the current time and t„ is the time of the last update. The process then 
moves on to step 426 to determine if the resource use of the server 6 is high or if any 
of the resources are above predefined threshold levels. If this is the case, then the 
congestion level c n is increased at step 430. The congestion level c n is defined as 

20 c n =min(c n ., + l,c TOX ) 

where c n is the current congestion level, c n , is the previous congestion level and Cmax 
is the maximum congestion level. So the congestion level is essentially incremented 
by one value. If the resource usage is determined not to be above predefined levels 
(not high), the process moves to step 428 to determine if the resource usage is low or 

25 in other words if all resources are below predefined threshold levels. If this is the case 
then the process moves to step 432 where the congestion level is decreased. The 
congestion level c n in this case is then defined as 

c n =max(c n .,-l,0) 

where c n , is the previous congestion level. Therefore the congestion level c n is 
30 decremented by one value. If both the resource usage is neither high nor low or 

20 April 1998 
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somewhere in between the predefined levels, then the process moves to 434 where 
updates take place in the history data base 22. This also occurs where an increase or 
decrease in the congestion level has occurred from steps 430 and 432 respectively. 

The updates that occur include other history information, besides congestion 
level, for resources such as the capacity of the link 14 and the interface unit 10. This 
information is stored as entries in a database which correspond to regular, specified 
time intervals. The values held by the control unit 20 are stored in the database 22 if 
the time interval I ftas elapsed since the last update. The time is then set to t= ^ where 
t is the current time and is the time of the last update. 

Once the update has taken place at step 434 the process moves to step 436 
where data is copied from the internal port 18 to the external port 16 of the interface 
unit 10. For each connection, if an error occurs or there is no remaining data to be 
sent the connection is closed. Where the interval I has not elapsed at step 424 if there 
is any data to be transferred between the ports 16 and 18 this takes place at step 436 as 
well. 

All of the rejection messages that have been stored at step 420 in a message 
buffer, associated with the external port, are sent to the respective clients at step 438 
and if there is no information remaining in the message buffer, then the connection is 
closed for each client. The process then reverts back to step 406. 

'Essentially the purpose of the data transfer and history updating unit 404 is to 
maintain the history information about the link 14 between the interface unit 10 and 
the server 6 and the resource usage of the server or servers 6. It is also used to transfer 
data between both the internal and external ports 18, 16 of the interface unit 10 and to 
send the rejection messages via the external port 16. The history information and 
congestion level are only updated if a specified time interval I has elapsed since the 
last update. 

Another admission control scheme is known as the percentage throttling 
admission scheme which allows a proportion of new sessions to be started according 
to the particular congestion level. A flow diagram depicting this scheme is shown at 
Figure 5 which is split into two parts, one part being for admission control 502 and the 
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other part being for data transfer and history updating 504. All of the steps shown in 
the flow diagram in Figure 5 are identical to those shown at Figure 4 except for a new 
step 509 and an altered admit step 512, both of which will be described hereinafter. 
Otherwise steps 506 through to 538 correspond to steps 406 to 438. As a result of the 

5 search query at step 508, if no active session, given the IP address of a connection, is 
found then the process moves to step 509 where a search is undertaken for any 
rejected history or session. This is a check to see whether a specific client has been 
rejected within a specified time period. If a recent session or recent history has been 
rejected then the connection is closed immediately at step 522, otherwise the process 

10 moves to step 510 where a search is made for an empty history entry or one that may 
be recycled. 

This additional decision action at step 509 addresses the problem of clients 
gaining admission by frequently making connections. Hence, whenever a connection 
arrives, it passes through a filter at this step 509. If the connection arrives from a 
15 client that has recently had a connection rejected, then the connection is closed 
without sending a rejection message. 

The admit step at 512 is shown in more detail in Figure 7. After step 510 the 
process moves to step 512 where at step 513 a calculation is made for the rejection 
proportion. This is the proportion of new connections to be rejected and is 

c 

Cmax 

20 

where p r is the proportion of connections to be rejected, c is the congestion level and 
c max i s *e maximum congestion level. At step 515 an admission determination is 
made to admit or reject a new connection. This will happen where p r < r where r is a 
random number between 0 and 1 inclusive, which is generated with each new 
25 connection. If the equation holds true the new connection is admitted and the process 
moves to step 516, otherwise the new connection is rejected and the process moves to 
step 514. 
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The implementation of the interface unit 10 has been performed in two ways. 
Firstly, a C implementation that maintains the active session table based only on the 
IP - address of the source of the request, and secondly using an Erlang based system 
which uses an active session table based on "cookies" to provide individual user 
5 identification for admission control. Cookies are a small quantity of data sent from a 
web server to a client and stored by the client. The value of a cookie can be requested 
by a web server. 

The interface unit 10 has been developed on a Sun Ultra Enterprise 2 
SparcServer, running Solaris 2.5.1 and Intel Pentium based computers running 

10 FreeBSD 2.2.2. It is assumed that the web server 6 has the Unix based "rstat" facility. 

Shown in Figure 8 there is a revised version of Figure 2 showing the message 
streams between the various components. The system 2 is separated into two 
networks, an inside network, comprising the servers 6 and a client side of the interface 
unit 10, and an outside network comprising a server side of the interface unit 10 

15 together with the Internet 8 and web clients 4. To the outside network, the interface 
unit 10 appears as a web server. Clients 4 located on the Internet 8 may query the 
interface unit 10 to gain access to pages held by any one of the web servers 6. When a 
user wishes to view a page held on the web server 6 their web client 4 opens a stream 
SI and issues request A to the interface unit's server side. Admission control is 

20 performed on this request using the IP address of the client or a cookie as the key. If 
the request is accepted, a stream S2 is opened to the web server 6 and the request is 
forwarded to the web server on link C. Otherwise a rejection message is sent to the 
client through link B via the stream SI to the client. The web server 6 responds to the 
request C using the stream S2 to the interface unit's client side and responds with the 

25 requested page D. The requested page is forwarded to the web client 4 through E via 
the open stream SI over the Internet 8. 

In normal operation all data read from web client 4 is copied to the web server 
6 and all data from the web server 6 is copied to the web client 4. However, a delay 
can be introduced to allow the contents of a data stream to be monitored by buffering 

30 the flow of data between the interface unit's server side and the web client 4 to 
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determine the nature of the request, and between the interface unit's client side and the 
web server 6 to recover HTTP status codes. Furthermore, data can be injected into the 
flow to allow a replacement page to be sent to the web client 4 or to augment an 
existing page. 

5 A number of statistics may be gathered by the interface unit 10 including the 

number of connection attempts, web server errors, the number of bytes transferred and 
the transfer rate. Additional statistics are gathered from the web server 6 using the 
"rstat" facility. There are two major versions of the HTTP protocol existing. 
HTTP/1.0 is the most common and opens and closes the streams for each file 

10 transferred from the web server 6. HTTP/1.1 is a newer protocol that opens a stream 
for a session and allows multiple requests and responses to be transferred through the 
streams. The current versions of the interface unit 10 are designed to handle both 
protocols. The C version implementation of the interface unit 10 will now be 
described. 

15. The C implementation is implemented as a single process which continuously 

loops through the actions of checking for new connections, admitting or rejecting 
offered connections and then servicing current connections by transferring bytes to 
and from the two buffers associated with the external and internal ports 1 6 and 18. . 
All memory including tables, history data and buffers is either static or 

20 allocated at start up. No dynamic memory operations occur in the main loop of the 
server. This simplifies the design and eliminates the need to handle the non- 
availability of a dynamic resource. 

With reference to Figure 9, the process 600 starts at step 602 where a listen 
socket is opened to check for new connections and existing connections. At step 604 

25 the connections are accepted and then the process moves to step 606 where a decision 
is made as to whether the connection is pending. If it is, it goes to step 608 where 
another decision is made to admit that connection otherwise if the connection isn't 
pending it goes to step 616 (to be described). At step 608, if the connection is not 
admitted it goes to a queue rejection at step 610 which in turn then goes to step 616. 

30 Otherwise, if the connection is admitted then the connection is opened to the web 
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server 6 at step 612. Once the connection is opened a record is inserted into the active 
connection table at step 614. When the connection is accepted by the interface unit 10 
a stream is opened up to the web server 6. The file handles of the stream SI from the 
client 4, as seen in Figure 10, and the stream S2 to the web server, are recorded in an 
5 empty slot in the active connection table. The active connection table also contains 
two buffers for bytes travelling from the web server and from the web client 
respectively as seen in Figure 10 also. These buffers are used to store incoming bytes 
read from a stream. If there is data in a buffer it is copied to the output stream and if 
there is a space in the buffer then data is read from the input stream. At step 616, 
10 periodically the process scans through the active connection table and the following 
copying processes take place: 

1. For each non-empty entry data is copied from the operating system 
buffers on the server side of the interface unit 10 into the "buffer of 
bytes from the web client" 4; 
15 2. Data is copied from the "buffer of bytes from the web client" 4 to the 

web server" 6; 

3. Data is copied from the operating system buffers on the interface unit's 
client side into the "buffer of bytes from the web server" 6; and 

4. Data is copied from the "buffer of bytes from the web server" 6 to the 
20 web client 4. 

When all of the bytes have been transferred from the buffers and both streams 
are closed, a slot in the active connection table is cleared and made available for 
another connection from a web client. So that statistics can be gathered from the web 
server using the rstat mechanism without blocking the transfer of data, a second thread 

25 of execution is introduced. This thread periodically makes rstat rpc calls and makes 
the data available through a data structure shared with the thread of execution that 
copies the data from the web client to the web server. 

The second implementation, the Erlang version, was developed and run using 
Erlang OTP R3A. The Erlang version consists of a collection of co-operating Erlang 

30 processes as to be described with reference to Figure 11. The initial function call 
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creates a listening socket at step 702 and a server process is spawned at step 704 
which is repeated on the right hand side. The server process then waits on an accept 
until a web client 4 opens a stream SI to the interface unit's server side. The stream is 
accepted at step 706 and another copy of the server is immediately spawned at step 

5 708. It is essential that a copy of the server process is always waiting in the accept 
state to ensure that the interface unit 10 is always able to handle a new request. 
Admission control is then performed at 710 and if the connection is not to be admitted 
then a rejection message is sent back to the client at step 712. If the connection is to 
be admitted, the Xfer routine is called at step 714. The Xfer routine is shown on the 

10 right hand side of Figure 1 1. The connection is then opened to the web server at step 
71 6 and data is copied from the client to the server and from the server to the client, or 
in other words between the web server and the web client at step 718 and then at step 
720 when both client and server sockets are closed, the process is stopped at step 722. 
If both sides of the connection are still open then the data copying process is still 

1 5 occurring at step 718. 

The Erlang implementation is more elegant than the C version. Using separate 
processes to handle each active connection allows code to be simplified and 
eliminates the need for a table of active connections. Once started, the Erlang 
processes perform the necessary data transfers and report their statistics without 

20 requiring oversight. 

Statistics are gathered from the web server 6 using the rstat mechanism and a 
piece of C glue code. The glue code makes a copy of the structure returned by rstat 
and converts it into an Erlang tuple. An Erlang process periodically polls the rstat 
service via the glue code. 

25 The system and method of the present invention allows a user, where they have 

access to a web server, to receive priority access to that server's resources over new 
users. This ensures that delay in moving from web page to web page on that server is 
minimised thereby ensuring that the service the user perceives is maintained at an 
acceptable level. 

30 Throughput is maintained at the highest possible level by ensuring that the 
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interface unit only controls traffic to the web server when the servers resources have, 
or are approaching, exhaustion. Therefore by controlling traffic before resources are 
exhausted on a server, the chances of the server breaking down are minimised. 

As an example, in a commercial environment such an idea is important when 

5 many customers of a company attempt to access the company's web home page to 
order products. Typically they will go to the company home page and click on a 
"products" link, and then possibly an "order form" link. If each of these moves is 
very slow, the customer is likely to be dissatisfied with the level of service received., 
particularly in the light of the time wasted. 

10 By employing the system of the present invention, the company in the above 

example ensures that accepted users receive good levels of service while other users 
are requested to return later when the server is less busy, thereby minimising the 
amount of time they waste. 

DATED: 20 April 1998 

CARTER SMITH & BEADLE 
Patent Attorneys for the Applicants 
ERICSSON AUSTRALIA PTY LTD and 
ROYAL MELBOURNE INSTITUTE OF TECHNOLOGY 
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